Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

e2e: Remove broken OpenTable test #95674

Merged
merged 1 commit into from
Oct 24, 2024
Merged

Conversation

anomiex
Copy link
Contributor

@anomiex anomiex commented Oct 24, 2024

Proposed Changes

The test has been broken for some time now, since upstream has changed the private API we had been using. Time to disable it, so as not to accidentally hide failures in anything that gets tested after it.

See Automattic/jetpack#39410 for details.

Why are these changes being made?

See above

Testing Instructions

  • Run test/e2e/specs/blocks/blocks__jetpack-earn.ts against various sites, see that it completes successfully.

Pre-merge Checklist

  • Has the general commit checklist been followed? (PCYsg-hS-p2)
  • Have you written new tests for your changes?
  • Have you tested the feature in Simple (P9HQHe-k8-p2), Atomic (P9HQHe-jW-p2), and self-hosted Jetpack sites (PCYsg-g6b-p2)?
  • Have you checked for TypeScript, React or other console errors?
  • Have you used memoizing on expensive computations? More info in Memoizing with create-selector and Using memoizing selectors and Our Approach to Data
  • Have we added the "[Status] String Freeze" label as soon as any new strings were ready for translation (p4TIVU-5Jq-p2)?
  • For changes affecting Jetpack: Have we added the "[Status] Needs Privacy Updates" label if this pull request changes what data or activity we track or use (p4TIVU-aUh-p2)?

The test has been broken for some time now, since upstream has changed
the private API we had been using. Time to disable it, so as not to
accidentally hide failures in anything that gets tested after it.

See Automattic/jetpack#39410 for details.
@anomiex anomiex added [Pri] Normal [Status] Needs Review The PR is ready for review. This also triggers e2e canary tests and wp-desktop tests automatically. [Type] Janitorial labels Oct 24, 2024
@anomiex anomiex requested review from kraftbj, jeherve and a team October 24, 2024 14:37
@anomiex anomiex self-assigned this Oct 24, 2024
Copy link
Contributor

@tbradsha tbradsha left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I can confirm the test is consistently broken in trunk (I've also seen it in E2E tests), and that this branch disables the broken test.

Also, this cuts nearly 2 minutes off of the test suite run (which had 10x retries, all of which would fail!), which would run twice in TeamCity.

@matticbot
Copy link
Contributor

This PR does not affect the size of JS and CSS bundles shipped to the user's browser.

Generated by performance advisor bot at iscalypsofastyet.com.

@anomiex anomiex merged commit 2c9856b into trunk Oct 24, 2024
15 checks passed
@anomiex anomiex deleted the fix/e2e-skip-broken-opentable-test branch October 24, 2024 14:52
@github-actions github-actions bot removed the [Status] Needs Review The PR is ready for review. This also triggers e2e canary tests and wp-desktop tests automatically. label Oct 24, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants